An Approach to Evaluate AI Commonsense Reasoning Systems
نویسندگان
چکیده
We propose and give a preliminary test of a new metric for the quality of the commonsense knowledge and reasoning of large AI databases: Using the same measurement as is used for a four-year-old, namely, an IQ test for young children. We report on results obtained using test questions we wrote in the spirit of the questions of the Wechsler Preschool and Primary Scale of Intelligence, Third Edition (WPPSI-III) on the ConceptNet system, which were, on the whole, quite strong.
منابع مشابه
Qualitative Spatial Reasoning Using Real Algebraic Geometry
Commonsense reasoning is a major challenge in Artificial Intelligence (AI). As qualitative descriptions comprise a great deal of our everyday language, commonsense reasoning is concerned with developing and processing such qualitative representations. This applies especially to commonsense reasoning about space, where spatial objects are in particular characterized by their spatial relations to...
متن کاملBeating Common Sense into Interactive Applications
been to put commonsense knowledge into computers—enabling machines to reason about everyday life. Some projects, such as Cyc, have begun to amass large collections of such knowledge. However, it is widely assumed that the use of common sense in interactive applications will remain impractical for years, until these collections can be considered sufficiently complete and commonsense reasoning su...
متن کاملLogic in Nonmonotonic Reasoning
We present a conceptual description of nonmonotonic formalisms as essentially two-layered reasoning systems consisting of a monotonic logical system, coupled with a mechanism of a reasoned choice of default assumptions. On this ‘surgery’, the main features of a nonmonotonic formalism are determined by the interplay between its logical basis and the nonmonotonic overhead. Furthermore, it allows ...
متن کاملAnthropomorphic Self-Models for Metareasoning Agents
Representations of an AI agent’s mental states and processes are necessary to enable metareasoning, i.e. thinking about thinking. However, the formulation of suitable representations remains an outstanding AI research challenge, with no clear consensus on how to proceed. This paper outlines an approach involving the formulation of anthropomorphic self-models, where the representations that are ...
متن کاملCommonsense Interpretation of Triangle Behavior
The ability to infer intentions, emotions, and other unobservable psychological states from people’s behavior is a hallmark of human social cognition, and an essential capability for future Artificial Intelligence systems. The commonsense theories of psychology and sociology necessary for such inferences have been a focus of logic-based knowledge representation research, but have been difficult...
متن کامل